Unique Sparse Decomposition of Low Rank Matrices
نویسندگان
چکیده
The problem of finding the unique low dimensional decomposition a given matrix has been fundamental and recurrent in many areas. In this paper, we study seeking rank $Y\in \mathbb{R}^{p\times n}$ that admits sparse representation. Specifically, consider $Y = A X\in where $A\in r}$ full column rank, with $r < \min\{n,p\}$, $X\in \mathbb{R}^{r\times is element-wise sparse. We prove $Y$ can be uniquely identified, up to some intrinsic signed permutation. Our approach relies on solving nonconvex optimization constrained over unit sphere. geometric analysis for landscape shows any {\em strict} local solution close ground truth solution, recovered by simple data-driven initialization followed second order descent algorithm. At last, corroborate these theoretical results numerical experiments.
منابع مشابه
A Sparse Decomposition of Low Rank Symmetric Positive Semidefinite Matrices
Suppose that A ∈ RN×N is symmetric positive semidefinite with rank K ≤ N . Our goal is to decompose A into K rank-one matrices ∑K k=1 gkg T k where the modes {gk} K k=1 are required to be as sparse as possible. In contrast to eigen decomposition, these sparse modes are not required to be orthogonal. Such a problem arises in random field parametrization where A is the covariance function and is ...
متن کاملBeyond Low Rank + Sparse: A Multi-scale Low Rank Decomposition
We present a multi-scale version of low rank matrix decomposition. Our motivation comes from imaging applications, in which image sequences are correlated locally on several scales in space and time rather than globally. We model our data matrix as a sum of matrices, where each matrix has increasing scales of locally low-rank matrices. Using this multi-scale modeling, we can capture different s...
متن کاملSparse and Low-Rank Tensor Decomposition
Motivated by the problem of robust factorization of a low-rank tensor, we study the question of sparse and low-rank tensor decomposition. We present an efficient computational algorithm that modifies Leurgans’ algoirthm for tensor factorization. Our method relies on a reduction of the problem to sparse and low-rank matrix decomposition via the notion of tensor contraction. We use well-understoo...
متن کاملRank Aggregation via Low-Rank and Structured-Sparse Decomposition
Rank aggregation, which combines multiple individual rank lists to obtain a better one, is a fundamental technique in various applications such as meta-search and recommendation systems. Most existing rank aggregation methods blindly combine multiple rank lists with possibly considerable noises, which often degrades their performances. In this paper, we propose a new model for robust rank aggre...
متن کاملCombinatorial Conditions for the Unique Completability of Low-Rank Matrices
We consider the problems of completing a low-rank positive semidefinite square matrix M or a low-rank rectangular matrix N from a given subset of their entries. Following the approach initiated by Singer and Cucuringu [20] we study the local and global uniqueness of such completions by analysing the structure of the graphs determined by the positions of the known entries of M or N . We present ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE Transactions on Information Theory
سال: 2023
ISSN: ['0018-9448', '1557-9654']
DOI: https://doi.org/10.1109/tit.2022.3223230